Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update test case related to LEACY datetime format to unblock nightly CI #11544

Merged
merged 6 commits into from
Oct 8, 2024

Conversation

res-life
Copy link
Collaborator

@res-life res-life commented Sep 30, 2024

Closes #11539

Changes

Update test case: Only test years after 1900

Description

This issue is related to LEGACY mode, Spark itself has different behaviors between LEGACY mode and non-LEGACY mode, and Rapids kernel has not 100% matched non-LEGACY yet.
Rapids keeps consistent with Spark when mode is CORRECTED mode.

We already documented that LEGACY mode has several limitations

So only update test case.

Signed-off-by: Chong Gao [email protected]

@res-life
Copy link
Collaborator Author

build

@res-life
Copy link
Collaborator Author

Do we need to update the 24.10 branch? @pxLi

@pxLi
Copy link
Collaborator

pxLi commented Sep 30, 2024

Do we need to update the 24.10 branch? @pxLi

yes, this is blocking 24.10 interminttently

@pxLi pxLi added the test Only impacts tests label Sep 30, 2024
@res-life res-life changed the title Disable a case related to LEACY datetime format to unblock nightly CI Update test case related to LEACY datetime format to unblock nightly CI Sep 30, 2024
@pxLi
Copy link
Collaborator

pxLi commented Sep 30, 2024

can you retarget to 24.10? thanks

@res-life
Copy link
Collaborator Author

can you retarget to 24.10? thanks

This PR is fixing 24.10.

@res-life
Copy link
Collaborator Author

build

@res-life
Copy link
Collaborator Author

res-life commented Oct 8, 2024

build

@res-life
Copy link
Collaborator Author

res-life commented Oct 8, 2024

Updated, only test years after 1900.
Regexp is: 19xx years or [2-9]xxx years.
For the MMdd and mmdd formats, just use [0-9]{4} format. If month is invalid like 13 month, then both CPU and GPU produce NULL.

firestarman
firestarman previously approved these changes Oct 8, 2024
@res-life
Copy link
Collaborator Author

res-life commented Oct 8, 2024

Will confilct with branch-24.10: #11567
Use this code instead of branch-24.10 will be OK.

@res-life
Copy link
Collaborator Author

res-life commented Oct 8, 2024

build

@revans2 revans2 merged commit cd46572 into NVIDIA:branch-24.12 Oct 8, 2024
45 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants